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ONERA 


Abstract—Decision-Aid Methods (DAMs) such as the Cost- 
Benefit Analysis (CBA) and the Analytical Hierarchy Process 
(AHP) help decision-makers to rank alternatives or to choose 
the best one among several potential ones. The new Belief 
Function based Technique for Order Preference by Similarity 
to Ideal Solution (BF-TOPSIS) methods have been recently 
developed for Multi-Criteria Decision-Making problems. In 
this paper, we compare CBA, AHP and BF-TOPSIS methods 
through an actual application case to natural risks in mountains. 
The CBA is the most used approach but is limited. Classical 
Multi-Criteria Decision-Aid methods (MCDAs) such as the AHP 
help to go further. The BF-TOPSIS methods notably show a 
robustness to rank reversal problems in the problem under 
concern, with a tractable complexity. Moreover, some steps of 
these new methods can be included in other MCDAs developed 
under the belief function theory framework. 


Keywords: multi-criteria, decision-making, BF-TOPSIS, be- 
lief functions, efficiency, torrential protection works. 


I. INTRODUCTION 


Real life Decision-Making Problems (DMPs) depend on 
several criteria for which precise or imperfect evaluation can 
be provided. Economic aspects are also of main importance to 
compare and choose strategies or measures. For instance, in 
mountainous areas, risk managers must rank several protective 
actions against torrential floods to choose the best one. 

Several Decision-Aid Methods (DAMs) are useful to solve 
such DMPs. In CBA! approach, all relevant elements, such 
as environmental issues and damage caused by natural haz- 
ards, are transformed into monetary terms revealing people’s 
preferences [1]. Since damage knowledge is uncertain, their 
expected value is generally used to introduce the risk concept 
[2]. In practice, CBA thus compares all mitigation alternatives 
taking into account three economic criteria: 1) the initial 
investment cost, 2) the global maintenance cost, and 3) the 
global risk reduction [3]. CBA remains the most used method 
but monetary valuation of non material assets is still an ethical 
issue in practice [4]. In this context, other methods have been 
developed and used. 

Multi-Criteria Decision-Aid methods (MCDAs) use scoring 
against weighted criteria to express preferences [5]. To rank all 
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alternatives and choose the best among them, single synthe- 
sizing criterion approaches such as AHP? [6] and MAUT? [7] 
use a step of data normalization or utility transformation. Out- 
ranking methods such as ELECTRE* [8] reject the hypothesis 
of a total pre-order of the decision-maker (DM) preferences 
and cope with their non-transitivity. Alternatives are compared 
pairwisely, sometimes without being able to specify any strict 
preference. Other methods such as ERV5 [9] and TOPSIS® 
[10] evaluate more precisely how each alternative is, to some 
extent, better or worse than the others. 


To support MCDM problems based on imperfect evalua- 
tions, belief function theory makes it possible to represent all 
kinds of imperfect information given by a source through a 
basic belief assignment (BBA) [11]. The new BF-TOPSIS’ 
methods presented in a companion paper [12] improves classi- 
cal MCDM support. This paper aims to demonstrate it through 
an actual example of DMP about choosing the most efficient 
protection alternative against torrential floods. Classical CBA 
is first applied to highlight difficulties of practical monetary 
valuation of all criteria. AHP is then used to aggregate all 
benefits and cost criteria, as proposed in [13]. In this paper, 
we finally show that the new BF-TOPSIS methods not only 
improve the CBA process taking into account all decision 
criteria, but are also more robust to rank reversal problems 
than the AHP. 


In section I, we describe the classical MCDM problem 
and briefly introduce CBA and AHP. We then recall some 
basics of belief functions in Section III. The BF-TOPSIS 
methods are only briefly introduced in Section IV because 
they are detailed in [12] with examples. The CBA, AHP and 
BF-TOPSIS are implemented to a real case of a classical 
MCDM problem in Section V. In Section VI, we finally discuss 
the improvements obtained by the BF-TOPSIS and imagine 
some potential combinations with other MCDAs to support 
unclassical MCDM problems under epistemic uncertainty. 
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II. CLASSICAL MCDM PROBLEM AND METHODS 
A. Classical MCDM problem 


A classical MCDM problem can be formalized by a given 
M x N score matrix S = [S;;] as expressed in Eq. (1), where 
M > 2 is the number of alternatives (or measures, choices, 
solutions) A; (i = 1,..., M), and N > 1 is the number of 
criteria Cj (j = 1,..., N). Each Sj; is the score of A; for 
a criterion C’;. Each Cj has an importance (or preference) 
weight w; C [0,1], and we assume that the weighting factors 
are normalized, aa wy = 1. 


Cl, wy C; Wj CN, WN 
A, Si4 Sij Sin 
Sê A; Sit Sij SiN (1) 
Am| Sm Sj SMN 


The MCDM problem is about choosing the best alternative 
Aj» € A {Aj, A2,..., Am} given the score matrix S and 
the importance weighting factors wj, j = 1,..., N. 


B. The CBA actually used to support natural hazard DMP 


Torrential floods can damage several elements such as 
housing, roads, and factories. Nearby a torrent, we denote Q 


the total number of individual elements ze (e = 1,...,Q) 
at torrential risk. R,, is the annual risk, or potential damage 
(losses), for each ze. Their sum for e = 1,..., gives in 


Eq. (2) the annual total risk denoted Rg. To calculate each 
Rz., Eq. (2) considers p(y) the continuous annual probability 
distribution of an intensity criterion of interest y (e.g. volume 
for debris flows), V(z-,y) the potential damaging rate (or 
vulnerability) of ze given y, and q(ze) its exposure rate 
[14]. Each ze is monetary valued in €. From an operational 


standpoint, several discrete scenarii represent p(y) [3]. 


Q Q 
Ro Ê > Rz 4 5 q(ze)-Ze- f PW y)dy (2) 
e=1 e=1 

Reo is the baseline annual risk, calculated through Eq. 
(2) with baseline p(y), V(ze,y) and q(ze), e = 1,...,. 
One considers M potential protective solutions A;, i = 
1,...,M. Each one reduces Reo to a residual annual risk 
Roi (i = 1,..., M). For each A;, Ro, is calculated through 
Eq. (2) with corresponding p(y), V (ze, y), and q(z-), different 
from the baseline ones. One finally computes the annual risk 
reduction Roo — Ro; G = 1,..., M). 

Let us consider the following example to establish the 
score matrix S. t is the temporal horizon of the project and 
qp C [0,1],p = 1,...,¢ is the annual discount rate. We 
consider N = 3 with C the investment cost, Co the global 
maintenance cost within n years, and C3 the global risk 
reduction within n years. All S;; values are assessed in €. 
For each A;, Cı is directly valued to give S;1. Sj2 depends 
on the annual maintenance cost Ki. S;i3 is related to the annual 


risk reduction Roo — Ro. The higher are S;; and Sj, the 
more costly is A;: the DM wants to minimize them. The 
higher is 53, the better is A;: the DM wants to maximize 
it. A;- is thus chosen with i* arg max;{NPV;}, or with 
i* £ arg max;{r;}, where the net present value NPV; and the 
benefit cost ratio r; are defined by: 
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C. The single synthesizing criterion approaches 


One of the criticisms of CBA is the monetary valuation 
of Siz. Other scales, and thus risk Ro defined in Eq. (2), 
should be considered to assess human life, environmental, and 
psychological damage or losses [4]. MCDAs can overcome 
this lack [5]. We focus on the widely used AHP method [6]. 
We briefly recall its principles (see Fig. 1) to draw decision 
according to the score matrix S, because we will compare our 
new BF-TOPSIS methods to AHP in the sequel. 
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Fig. 1. Main steps of the AHP method. 


e AHP Step 1: Analyze and split the DMP arranging criteria 
in a hierarchical structure descending from a decision goal 
to criteria, sub-criteria and finally alternatives in successive 
levels. 

e AHP Step 2: For each level of the hierarchical structure, 
preference matrices are built on pairwise comparisons. For 
any X and Y assessed through the same unit, each hypothesis 
X > Y (X is preferred to Y) is quantified by a Preference 
Level (PL) value PL. x,y € [1;9] through the assessment of 
Table I. For instance, for the set C, one can compute an N x N 
matrix Pc as in (5). In the classical AHP, the column N-vector 


w = [wi,...,Wj,---, wn]? corresponds to the eigenvector of 


Pc with well-known issues such as the rank reversal [15]. For 
each j‘”-column, one normalizes each element by the sum of 
all its elements, giving a normalized N x N matrix. For each 
jth _line, one calculates the sum of all normalized elements, 
giving an N column vector. One normalizes each of its element 
by the sum of all elements, giving w. As pairwise comparisons 
may not be totally consistent, a last step consists in checking 


the consistency of these results. 


TABLE I 
PREFERENCE LEVEL PL xy y ASSESSMENT TABLE. 























Qualitative preference X > Y PLx yy | Ply, x 
(X) is as important as (Y) 1 1 
is somewhat more important than 3 1/3 
is more important than 5 1/5 
is far more important than 7 1/7 
is absolutely more important than 9 1/9 
Ci ie: G Cy 
Cy 1 PLoy+c; PLoyycy 
Po ê Cj PLoj+cy Ave 1 PLo;+cyn 
Cn | PLony cy PLoy>+c; pru 1 


(5) 


e AHP Step 3: For the lowest sub-criteria level and for each 
sub-criteria, for instance C}, the classical AHP method, called 
criteria-solution, uses the same approach as in the Step 2 
to get an M x M preference matrix Pc, not for criteria 
but for alternatives. The M/-eigenvector of normalized score 
sj = [81j;,---,Sij,---,$my]/_ is then extracted. N vectors s; 
are established. For DMPs with numerous alternatives, another 
criteria-evaluation-solution exists [16] since the pairwise com- 
parison cannot be reasonably done on large matrices [17]. 

e AHP Step 4: Finally, the synthesizing score S; is deduced 
for each A; by an additive aggregation operation according to 
(6). Aj» is chosen with i* = arg max;{;}. 


M 
Si = X wj.sij (6) 
j=1 


For quantitative MCDM problems, other methods make it 
possible to extract the normalized M-vector s; replacing the 
AHP step 3. For instance, a second way is to normalize each 
Sij by the maximum or the sum of sj. To some extent, 
the approach is similar to the Multi-Attribute Utility Theory 
(MAUT) which establishes the utility function uj, specific to 
each Cj, giving sij = u,(5;;). Once s; is computed, the 
step 4 can be replaced by other aggregation rules such as the 
multiplicative one [15]. 


III. BASICS OF THE BELIEF FUNCTION THEORY 
Originally proposed by Shafer in [11], the belief function 


theory is based on representing imperfect knowledge through 


basic belief assignments (BBAs). We briefly introduce it in the 
context of MCDM problems. One starts specifying the frame 
of discernment (FoD) of the DMP under consideration denoted 
by the finite discrete set ©. Each element of the FoD is a 
potential alternative (or solution) of the DMP, and the elements 
of © are assumed exhaustive and mutually exclusive. The 
powerset of © denoted 2° is the set of all subsets of ©, empty 
set included. A body of evidence is a source of information 
that will help the decision-maker to identify the best element 
of the FoD as the solution of the problem. The interest of belief 
functions is their ability to model epistemic uncertainties. 
Each body of evidence is characterized by a BBA, or a 
mass of belief, which is a mapping m(-) : 2° — [0,1] 
that satisfies m(Ø) = 0, and for all A # Ø € 2° the 
condition 5) 4ce m(A) = 1. The Belief function Bel(-) and 
the Plausibility function PI(-) are defined from m(-) by: 


Bel(A)= XO m(B) (7) 
BCA|Be2° 

P(A) X` m(B) (8) 
BNA#0|BE29 


The credibility Bel(A) and the plausibility PI(A) are often 
interpreted as lower and upper bounds of the unknown prob- 
ability of A. The vaccuous BBA defined as m,(©) = 1 
models the full ignorant source of evidence. In 1976, Shafer 
did propose Dempster’s rule to combine distinct sources of 
evidence [11] which has been subject to strong debates in 
fusion community starting from Zadeh’s first criticism in 1979 
[18]. Since 1990’s many alternatives have been proposed to 
combine more or less efficiently belief functions, as well as 
an extension of belief function in the framework of Dezert- 


Smarandache Theory (DSmT) as shown and discussed in [19]. 


IV. THE BF-TOPSIS METHODS 


Four BF-TOPSIS methods have been recently proposed in 
[12] with an increasing complexity and robustness to rank re- 
versal phenomenon. All these methods start with constructing 
BBAs from the score values of the matrix S as explained in 
the next subsection. Only the way those BBAs are processed 
differs from one BF-TOPSIS method to another one. 


A. Construction of BBAs from the score matrix S 


In [12], one has proved that BBAs can be consistently built 


from S by computing Bel;;(A;) and Bel,;(A;) defined by: 


Sup; (Ai) if AD 

Belij(Ai) £ d Abax Amex #0 (9) 

0 if Alax = 0 

E mild fA 0 
Bel;; (Ai) £ A is ! pan 7 (10) 

0 if A’, =0 

where A; is the complement of A; in ©, and 
Sup,(Ai) + 5 [Sij — Sey (11) 
kE{1,...,M}Sp5 S53; 

Inf ,(Ai) ê — 5 |Sig — Skyl (12) 


kE{1,...,M}|Skj > Sij 


The denominators involved in Eqs. (9)-(10), are defined by 
Alax = max;Sup;(A;) and Afin = minjlnf;(A;), and 
they are supposed different from zero®. With this principle of 
construction, Bel;;(A;) and Bel;;(A;) belong to [0; 1] and are 
consistent because the equality Pl;;(A;) = 1—Bel;;(Aj;) holds 
(see the mathematical proof in [12]). Therefore, the belief 
interval of choosing A; considering C} is given by: 
Sup ;(Ai) Inf ,(Ai) 
Abrax Alin 
From this belief interval, we deduce the BBA m,,(-) which 
is the triplet (Mij (4i), Mij (Ai), Mij (A; U Aj;)) defined by: 





[Bel;; (Ai); Plij(Ai)] £ [ } a3 


? 


mig (Ai) = Beli; (Ai) (14) 
Mij (A;) 4 Bel;;(Ai) =1- Pl; (Ai) (15) 
Mij (Ai U Ai) 4 Mij (9) = Pli; (Ai) = Bel;; (Ai) (16) 


If a numerical value 5;; is missing in S, one uses Mijl) 4 
(0,0,1), i.e. one takes the vacuous belief assignment. 

Using the formulae (9)-(16), we obtain from any M x N 
score matrix S the general M x N matrix of BBAs for © = A 
defined by: 


Cı, w1 Cj, wj CN, WN 

Aj mil) miızj(-) min(:) 
MÊ A; | mal) mMij(-) minl) | 07 

hm eiat e ian 


B. The BF-TOPSIS methods 


Four BF-TOPSIS methods have been presented in details in 
[12]. We only briefly recall them. All these methods use the 
BBA construction presented in the subsection IV-A first to 
establish BBA matrix M and then, the Belief Interval-based 
Euclidean distance between BBAs proposed in [20]. 


Principle of BF-TOPSIS1: From the BBA matrix M and for 
each alternative A;, one computes the Belief Interval-based 
Euclidean distances d8; (m;; jm mps) (defined in [20]) between 
Mij(+) and the ideal best BBA defined by mbes'( Aj) ) £ 1, and 
the distances dË r(Mij, mie") between M and the ideal 
worst BBA defined by m¥%st( A;) 1. Then, one computes 
the weighted average of dE;(m;j, m?*) values with relative 


ij 
importance weighting factor w; of criteria C}. Similarly, one 


computes the weighted average of d% (Mij, mọ) values. 
More specifically, one eee 
iad C2 ay wj- dE;( Mij, m moss) (18) 
hail @ ay W; del Mij, m mir) (19) 


81f Alax = 0 then Beli; (Ai) = 0, and if AÏ. 


S A = 0 then Pli; (Ag) =k 
so that Beli; (Ai) = 0. 


The relative closeness of the alternative A; with respect to the 
ideal best solution A>**' defined by: 

dvst(A;) 
dworst( A; ) + dbest( A; ) 
is used to make the preference ordering according to the 
descending order of C(A;, A°*) € [0,1], where a larger 
C(A;, AP) value means a better alternative. 





C(A;, A™*) £ (20) 


Principle of BF-TOPSIS2: In this method, one computes at 
first the relative closeness of each alternative A; w.r.t. its ideal 
best solution Ae for each criteria C; by: 

aa) 


meS) + dE (mig, mis) 


E 
dp (miz,m 





CA Amys (21) 


dE (mig, 


The global relative closeness of each alternative A; with 
respect to its ideal best solution A> is then obtained by the 
weighted average of C;(A;, As). More specifically by 


Euo 


which is used to make the final preference ordering. 


A;, AP) & Ay A ) (22) 


Principle of BF-TOPSIS3: This method is more complicated 
to implement because it uses PCR6 fusion rule [19] to combine 
BBAs also taking into account the importance factors wj. For 
each alternative A;, one fuses the N BBAs m,,;(-) discounted 
with importance factor wj (see [21] for details) from the i-th 
row of the BBA matrix M with PCR6 rule of combination. 
One gets the fused BBA m?C"® for each Aj, from which 
one computes the Belief Interval-base Euclidean distance 
dest ( A;) = ae (mł PC R6 nee) between mPORE(. -) and 
its ideal best BBA mèest(A;) £ 1. Similarly, one computes 
the distance d¥°T%(A;) = d#;(mPOE6, mworst) between 
mPCRS(.) and mverst(A;) 1. The relative closeness of 
each A; with respect to ideal best solution C(A;, A°®*') is 
computed by Eq. (20), and is used to make the preference 
ordering according to the descending order of C(A;, A°°**). 


Principle of BF-TOPSIS4: This method is similar to BF- 
TOPSIS3 except that we use the more complicate ZPCR6 
fusion rule which is a modified version of PCR6 rule taking 
into account Zhang’s degree of intersection of focal elements 
in the conjunctive consensus operator. ZPCR6 rule is explained 
in details with examples in [22]. 


V. APPLICATION OF BF-TOPSIS TO PROTECTIVE ACTION 
TO TAKE WITHIN A TORRENTIAL WATERSHED 


A. Formalization of the actual MCDM problem 


To mitigate the risk of an area exposed to torrential floods, 
one considers, as an example, four solutions: 

e Al: 

e Ao: 

. As: 

e Ag: 


doing nothing; 

building several check dam series in the headwaters; 
building a sediment trap upstream the torrential fan; 
mixing implementation of Az and A3. 


Moreover, public authorities often wish to compare those 
solutions with another one: 

e As: individually protecting each element at risk. 

Therefore, to help the DM, we assume that the expert must 
compare the first four alternatives (let us call it case 1 with 
M=4) and then integrate the As in a global comparison (let 
us call it case 2 with M=5) (see Fig. 2). 


Protective alternatives 


Az: check dam series 


orrential watershea 


As: individual protections 
ae 


ae 





Fig. 2. Potential alternatives of the real DMP. 


The DM considers five criteria (NV = 5) and wants to 
minimize C1, C2 and to maximize C3, C4 and Cs with: 
e Cı: the investment cost in €; 


e Co: 
e C3: 


the annual maintenance cost in € (S;2 = ki); 
the annual risk reduction in m? of houses damaged; 

e C4: the annual risk reduction in human casualties; 

e Cs: the annual risk reduction in number of sites danger- 

ous to environment in area at risk. 

To compare criteria in pairs, the DM gives the preference 
matrix Pc according to the AHP method [6]. Implementing 
the AHP step 2 gives the importance weighting vector w = 
(0.08, 0.04, 0.10, 0.46, 0.32]” recalled in the Table II. It corre- 
sponds to the importance ranking: Cy > C5 > C3 > Cy > Co. 


Cy Cy C3 Cy OF 


Gf 1 4 05 1/7 0.25 
C2|0.25 1 0.25 1/9 1/6 

Po= C3} 2 4 1 02 1/7 (23) 
Cie 9 5 1 22 
C| 4 6 7 05 1 


For each A; and C}, the DM assesses the S;; value to 
establish the score matrices Scase and Sease2 shown in Table 
IL. 

In the next subsections, we provide intermediary results for 
each method to help the reader to check by himself the validity 
of our final ranking vectors gathered in comparative Tables 
XIII (for case 1) and XIV (for case 2) in the subsection V-E. 


B. Implementation of the CBA method 


The CBA steps are applied to the two 4 x 5 and 5 x 5 
score matrices Scase and Scase2 given in the Table I. For each 
alternative A; and each criterion C}, the score S;; must be 














TABLE II 
SCORE MATRICES Scase1 (WITHOUT A5) AND Scase2 (WITH As). 

Cj Ch C2 C3 C4 C5 
Wj 0.08 0.04 0.10 0.46 0.32 

Ay 0 0 0 0 0 
al B| A2 300 000 6 000 5 0.007 0.02 
2| | A3 | 300000 1500 5 0.008 0.04 
n Aas | 600000 7500 7 0.008 0.05 
As 1 000 000 0 7 0.008 0.1 














transformed into monetary value SS. For C3, we assume an 
average price of 2 300 €/m? for houses built in any of the 
eleven French mountainous departments’: SS =2 300- S;i3 (Si3 
given in the Table II). As transforming C's in monetary value 
is a difficult process, it is not generally done in practice: we 
assume Se = 0. Practical monetary valuation of human life 
is discussed and we extract two methods: 
e Method 1: with no human life monetary valuation for 
C4, one assumes S$, = 0; 
e Method 2: considering 2.5 million € as the average price 
of one human life [23], one assumes el =2 500 000- S;4 
(S;4 given in the Table II). 
To apply the CBA, the two 4 x 5 and 5 x 5 score matrices 
Sease] and Sease2 are transformed into two 4 x 3 and 5 x 3 
score matrices SFe and S€_., in Table III. For each A;, the 


case2 


C3 score of global risk reduction in € is S$ + SẸ + S$. 


TABLE III 


€ € 
TRANSFORMED IN € SCORE MATRICES Se, 4, AND Séacp9- 














C3 
Ci C2 Method 1 Method 2 
Ay 0 0 0 0 
«| 3] A2 | 300000 6000 11500 29 000 
w4] Ge | As | 300000 1500 11500 31 500 
n A4 | 600000 7500 16100 36 100 
5 1000000 0 16 100 36100 

















As recommended in [24], we assume the temporal horizon 
n = 50 years and a fixed rate qp = 3%, Yp € [1, n]. For each 
A;, applying the formulae (3) and (4) gives the CBA results 
in the Table IV. 














TABLE IV 
NPV AND r RESULTS BY CBA. 
Method 1 Method 2 
Without monetary With monetary 
human life valuation | human life valuation 

NPV; Ta NPV; Ta 
Ax 0 - 0 — 
Ag | -158 487 0.65 291 784 1.64 
A3 -42 702 0.87 471 894 2.39 
A4 | -378 724 0.52 135 871 1.17 
As | -585 751 0.41 -71 156 0.93 

















NPV and r give the same preference ranking. We use NPV 
results to establish the decision ranking vector (see Tables XIII 
and XIV in the subsection V-E). 


°www.meilleursagents.com/prix-immobilier 


C. Implementation of the AHP method 


After AHP Steps | and 2 (see the subsection V-A), the AHP 
step 3 is applied on the two score matrices Scase and Scase2 
given in the Table II. Two methods of normalization have 
been tested to normalize each j-th column of Scasey and Scase2- 


Method 1: For each C;, the DM gives its preference matrix 
on the set of alternatives to get the normalized score matrices 
for case 1 and case 2 given respectively by Eqs. (24)-(25). 


Ch C2 C3 C4 Cs 
A; [0.643 0.576 0.038 0.037 0.042 
Az | 0.158 0.071 0.197 0.219 0.128 
A3 | 0.158 0.308 0.197 0.372 0.320 
A4 | 0.041 0.045 0.568 0.372 0.510 


Ch C2 C3 C4 Cs 

A, [0.515 0.368 0.028 0.028 0.032 

Ay |0.190 0.046 0.124 0.156 0.071 
Sito = A3|0.190 0.186 0.124 0.272 0.137 
A, | 0.073 0.032 0.363 0.272 0.228 

As | 0.032 0.368 0.363 0.272 0.532 


1 
Scasel = 


(24) 


(25) 


Method 2: One uses the classical normalization procedure!” 
and gets the normalized score matrices for case 1 and case 2 
given respectively by Eqs. (26)-(27). 


Cy C2 C3 Ca Cs 
A; [1.000 1.000 0.000 0.000 0.000 
Aə | 0.750 0.600 0.294 0.304 0.182 
A3 | 0.750 0.900 0.294 0.348 0.364 
Aa 0.500 0.500 0.412 0.348 0.455 


Ci C2 C3 C4 Cs 

A; [1.000 1.000 0.000 0.000 0.000 

A2 | 0.864 0.600 0.208 0.226 0.095 
S2,.. = As | 0.864 0.900 0.208 0.258 0.190 
A4 | 0.727 0.500 0.292 0.258 0.238 

As | 0.545 1.000 0.292 0.258 0.476 


Sse = (26) 


(27) 


For those four normalized score matrices, the ranking results 
S; given by the formula (6) of AHP step 4 are gathered in the 
Tables XIII (case 1) and XIV (case 2), see the subsection V-E. 


D. Implementation of the BF-TOPSIS methods 


The decreasing preference according to C and C2 must be 
first taken into account. The corresponding initial scores Sj, 
and S;2, i = 1,...,5 given in the Table II are thus multiplied 
by -1 to get the corresponding 4 x 5 (case 1) and 5 x 5 (case 
2) new score matrices geet and SP in the Table V. 

The BBA construction step of all BF-TOPSIS methods 
described in the subsection IV-A from these two matrices gives 
us the following BBA matrices shown in Tables VI (for case 
1) and VII (for case 2). 


BF-TOPSIS1 results: for each A;, the weighted averages 
of dB (mig, mee) and dB (mij, mE), j = 1,...,5 are 
computed with Eqs. (18) and (19). The results are gathered 
for all A;, i = 1,...,4 (case 1) and i = 1,...,5 (case 
2) in the Table VIII. For each A;, applying Eq. (20) gives 


l0by dividing each S;; value by Zj Sij- 


TABLE V 
PREF PREF 
SCORE MATRICES SPREE) (WITHOUT As) AND SPREE, (WITH As) TAKING 
INTO ACCOUNT THE PREFERENCE DIRECTION FOR EACH CRITERION Cj. 





























Cj C1 Cz C3. Oy Os 
wj 0.08 0.04 0.10 0.46 0.32 

A 0 0 0 0 0 
al s3] A2 | -300000 -6000 5 0.007 0.02 
22/ č] A3 | -300000 -1500 5 0.008 0.04 
n Aq | -600000 -7500 7 0.008 0.05 
As -1,000,000 0 7 0008 Ol 

TABLE VI 


BBA MATRIX IN CASE | (WITHOUT As). 













































































Ci C2 C3 C4 Cs 
m(A ) 1.000 1.000 0.000 0.000 0.000 
m(A2 U A3 U Ag 0.000 0.000 1.000 1.000 1.000 
m(© 0.000 0.000 0.000 0.000 0.000 
m(A2) 0.250 0.100 0.454 0.778 0.222 
m(Aı U A3 U Ag 0.250 0.700 0.118 0.087 0.455 
m(© 0.500 0.200 0.428 0.135 0.323 
m(A3) 0.250 0.700 0.454 1.000 0.667 
m(A U As U A4 0.250 0.100 0.118 0.000 0.091 
m(© 0.500 0.200 0.428 0.000 0.242 
m(A4) 0.000 0.000 1.000 1.000 1.000 
m(A U Ag U Ag 1.000 1.000 0.000 0.000 0.000 
m(© 0.000 0.000 0.000 0.000 0.000 
TABLE VII 
BBA MATRIX IN CASE 2 (WITH As). 
Cı C2 C3 C4 C5 
m(Aı 1.000 1.000 0.000 0.000 0.000 
m( A2 U A3 U Ag U As) 0.000 0.000 1.000 1.000 1.000 
m 9) 0.000 0.000 0.000 0.000 0.000 
m(A2 0.455 0.100 0.454 0.778 0.069 
m(A, U A3 U A4 U As) 0.107 = 0.733 0.167 0.097 0.619 
m 9) 0.438 0.167 0.379 0.125 0.312 
m(A3 0.455 0.700 0.454 1.000 0.207 
m(Aı U Ag U A4 U As) 0.107 = 0.733 0.167 0.000 0.333 
m 9) 0.438 0.167 0.379 0.000 0.460 
m(Aa 0.182 0.000 1.000 1.000 0.310 
m(Aı U A2 U A3 U As) 0.428 1.000 0.000 0.000 0.238 
m ©) 0.390 0.000 0.000 0.000 0.452 
m(A5 0.000 1.000 1.000 1.000 1.000 
m(Aı U A2 U A3 U As) 1.000 0.000 0.000 0.000 0.000 
m 9) 0.000 0.000 0.000 0.000 0.000 

















the relative closeness C(A;, A™*). The ranking vectors are 
deduced and shown in the comparative Tables XIII and XIV 
of the subsection V-E. 


TABLE VIII 
BF-TOPSIS1: RESULTS OF WEIGHTED AVERAGE DISTANCE IN CASE 1 
(WITHOUT A5) AND CASE 2 (WITH As). 








A case 1 case 2 

t dbest(_A;) d¥ost(A;) dbest(A;) qvorst (Aj) 
At 0.762 0.104 0.741 0.101 
A2 0.403 0.477 0.435 0.417 
A3 0.183 0.693 0.293 0.559 
A4 0.104 0.762 0.264 0.585 
As - - 0.067 0.774 

















BF-TOPSIS2 results: for each Cj and each Aj, the relative 
closeness C;(A;, A”*) is computed applying the formula (21). 
Results are gathered for all C}, j = 1,...,5 and all Aj, i = 
1,...,4 (case 1, Table IX), and all A;, i = 1,...,5 (case 
2, Table X). For each A;, the formula (22) gives the relative 
closeness C'(A;, At). The corresponding ranking vectors are 
given in the Tables XIII and XIV of the subsection V-E. 


TABLE IX 
BF-TOPSIS2: INTERMEDIARY Cj(A;, A®"S") IN CASE 1 (WITHOUT As). 

















Cy C2 C3 C4 Cs | 
A; | 0.080 0.120 0.120 0.120 0.120 
Az | 0.028 0.034 0.086 0.543 0.544 
A3 | 0.028 0.057 0.109 0.569 0.794 
A4 0 0 0.100 0.560 0.880 
TABLE X 


BF-TOPSIS2: INTERMEDIARY Cj (A;, A®"S") IN CASE 2 (WITH As). 








Cy C2 C3 C4 C5 | 
A, | 0.080 0.120 0.120 0.120 0.120 
A> | 0.040 0.044 0.093 0.455 0.493 
A3 | 0.040 0.068 0.117 0.577 0.660 
A4 | 0.018 0.018 0.118 0.578 0.692 
A5 0 0.040 0.140 0.600 0.920 











BF-TOPSIS3 results: for each A; and each case, the combina- 
tion step through the PCR6 rule (with importance discounting) 
of the five BBAs m;j(-), j = 1,...,5 gives the results of the 
Table XI. d°*'(A;) and d¥°'(A;) are directly computed giving 
the Table XII. Applying Eq. (20) gives the relative closeness 
C(A;, At), The corresponding ranking vectors are given in 
the comparative Tables XIII and XIV of the subsection V-E. 


TABLE XI 
BF-TOPSIS3: INTERMEDIATE RESULTS AFTER PCR6 COMBINATION 
WITHOUT As (CASE 1) AND WITH As (CASE 2). 




















case 1 case 2 
mE S | mien mins 
m(0) 0.904 0.000 0.904 0.000 
m(A1) 0.003 0.030 0.003 0.030 
m( A2 U A3 U Ag U As) 0.093 0.970 0.093 0.970 
m(@) 0.000 0.000 0.000 0.000 
m(0) 0.945 0.000 0.942 0.000 
m(A2) 0.041 0.743 0.039 0.674 
m(Aı U A3 U Ag U As) 0.008 0.145 0.014 0.234 
m(©O) 0.006 0.112 0.005 0.092 
m(0) 0.920 0.000 0.924 0.000 
m(A3) 0.076 0.954 0.064 0.847 
m(Aı U A2 U A4 U A5) 0.001 0.006 0.004 0.050 
m(©O) 0.003 0.040 0.008 0.103 
m(0) 0.904 0.000 0.922 0.000 
m(Aa) 0.093 0.970 0.068 0.873 
m(Aı U A2 U A3 U As) 0.003 0.030 0.003 0.038 
m(@) 0.030 0.000 0.007 0.089 
m(0) - - 0.904 0.000 
m(As) - - 0.094 0.977 
m(Aı U A2 U A3 U As) — - 0.002 0.023 
m(@) — - 0.000 0.000 

















TABLE XII 
BF-TOPSIS3 & 4: RESULTS OF WEIGHTED AVERAGE DISTANCE IN CASE 1 
(WITHOUT A5) AND CASE 2 (WITH As). 











A case 1 case 2 

t dbest(A;) d¥ost(A;) dest A;) qvorst (Aj) 
Ay 0.840 0.026 0.817 0.025 
A2 0.208 0.661 0.268 0.574 
A3 0.036 0.832 0.123 0.720 
A4 0.026 0.840 0.102 0.742 
As - - 0.020 0.822 














BF-TOPSIS4 results: As expected considering the compara- 
tive analysis made in [12], it provides the same results as with 
BF-TOPSIS3. 


E. Comparing results of methods for the same real DMP 


The comparative Tables XIII (case 1 - without A5) and XIV 
(case 2 - including A;) gather all the ranking results. 


TABLE XIII 
CBA, AHP & BF-TOPSIS RESULTS IN CASE 1 (WITHOUT As). 





= 
2 
> 
3 
a 
n 


Ranking vectors Preference orders 
0, -1.6, -0.4, -3.8].10° | Ai > A3 > Ao > A4 
[0, 2.9, 4.7, 1.4].10° A3 > Ag > A4 > Al 
0.11, 0.18, 0.32,0.40] | A4 > A3 > A2 > Ax 
0.12, 0.31, 0.40, 0.41] | A4 > A3 > Ao > At 
0.12, 0.54, 0.79, 0.88] | A4 > A3 > Ag > Ai 
0.12, 0.54, 0.79, 0.88] | A4 > A3 > Ag > Ad 
0.03, 0.76,0.96,0.97] | Ag > A3 > A2 > Ai 
0.03, 0.76,0.96,0.97] | A4 > A3 > Ao > At 





= 























BF-TOPSIS | AHP | CBA 
BWN FIN K/| NY 





TABLE XIV 
CBA, AHP & BF-TOPSIS RESULTS IN CASE 2 (WITH As). 

















Methods Ranking vectors Preference orders 

< 1 [0, -1.6, -0.4, -3.8, -5.9].10° | Ai > A3 > A2 > Aa > As 
O° 2 [0, 2.9, 4.7, 1.4, -0.7].10° A3 > A2 > Aa > At > As 
Bs 1 [0.07, 0.12, 0.20, 0.24, 0.35] | As > A4 > A3 > A2 > Al 
< 2 (0.12, 0.25, 0.31, 0.30,0.39] | A5 > A3 > A4 > A2 > Al 
Dn 1 [0.12, 0.49, 0.66, 0.69,0.92] | A5 > A4 > A3 > A2 > Al 
£ 2 | (0.12, 0.49, 0.66, 0.69, 0.92] | As = A4 = A3 = A2 > Ad 
& 3 | [0.03,0.68,0.85, 0.88, 0.97] | A5 + A4 => A3 > A2 > Aı 
s 4 | [0.03,0.68,0.85,0.88,0.97] | As = A4 + A3 = Az > Aı 














Even if there is no rank reversal problem while comparing 
CBA results in cases 1 and 2, the CBA method is very sensitive 
to monetary valuation with complete changes of preference 
order if one monetary values the human life (Method 2) or 
not (Method 1). 

Taking into account the environmental criterion Cs and the 
importance of each criterion Cj, the AHP changes the decision 
comparing to the CBA results. With the latter, the best choice 
is A, (CBA method 1) or A3 (CBA method 2) whereas it is 
As or A4 including (case 2) or not (case 1) As into the AHP 
process. For this example, the AHP method 1 (normalization 
using AHP preference matrices) is more robust to the rank 
reversal problem than using the AHP normalization method 


2. For the latter, the preference order is Ay > Ag for case 1 
(without As) switching in A3 > A4 for case 2 (including As). 

As the AHP, the BF-TOPSIS methods help to take into 
account all kind of quantitative criteria without monetary 
valuation step. For this example, they are robust to the rank 
reversal problem. Moreover, in comparison with the AHP 
method 1, there is no preference transformation which can 
be subjective and more complicated to implement. 


VI. CONCLUSION 


To help choosing the best action to implement within a 
torrential watershed, the most used method in practice is the 
CBA. Assuming a precise classical MCDM problem, we have 
shown in this paper that the CBA only takes into account 
few decision criteria and therefore does not provide fully 
satisfactory results. Classical MCDA methods such as the 
AHP help to improve it. Nevertheless, for quantitative DMP 
where all scores correspond to numerical values, we show that 
a direct normalization step induces rank reversal problems. 
We also show that the new BF-TOPSIS methods are more 
robust to rank reversal for this DMP. Moreover, they are easier 
to implement than the classical AHP involving preference 
matrices step. 

In this application context, precise score values are rarely 
available in actual DMP. Some methods, such as the ER- 
MCDA, have been developed to assess each alternative A; 
through a m,(-) on a FoD which corresponds to an evaluation 
scale [16], [25]. They have yet been applied to similar actual 


cases, to assess effectiveness of torrential protection works 
[26]. To go further in application to actual cases, some devel- 
opments are currently considered to integrate some steps of the 
BF-TOPSIS methods following the ER-MCDA methodology. 

In the same way, some decision-making methods under 
uncertainty such as COWA-ER and Fuzzy COWA-ER exist 
and have been applied to similar actual cases [26]. Some 
challenging developments are needed at all to integrate those 
approaches taking into account several sources of imperfect 
information under high uncertainty on the states of the nature. 
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